Bump ort-sys from 2.0.0-rc.9 to 2.0.0-rc.10 in /src-tauri - #22

Sourced from ort-sys's releases.

v2.0.0-rc.10

---

💖 If you find ort useful, please consider sponsoring us on Open Collective 💖

🤔 Need help upgrading? Ask questions in GitHub Discussions or in the pyke.io Discord server!

---

🔗 Tensor Array Views

You can now create a TensorRef directly from an ArrayView. Previously, tensors could only be created via Tensor::from_array (which, in many cases, performed a copy if borrowed data was provided). The new TensorRef::from_array_view (and the complementary TensorRefMut::from_array_view_mut) method(s) allows for the zero-copy creation of tensors directly from an ArrayView.

Tensor::from_array now only accepts owned data, so you should either refactor your code to use TensorRefs or pass ownership of the array to the Tensor.

⚠️ ndarrays must be in standard/contiguous memory layout to be converted to a TensorRef(Mut); see .as_standard_layout().

↔️ Copy Tensors

rc.10 now allows you to manually copy tensors between devices using Tensor::to!

// Create our tensor in CUDA memory
let cuda_allocator = Allocator::new(
	&session,
	MemoryInfo::new(AllocationDevice::CUDA, 0, AllocatorType::Device, MemoryType::Default)?
)?;
let cuda_tensor = Tensor::<f32>::new(&cuda_allocator, [1_usize, 3, 224, 224])?;
// Copy it back to CPU
let cpu_tensor = cuda_tensor.to(AllocationDevice::CPU, 0)?;

There's also Tensor::to_async, which replicates the functionality of PyTorch's non_blocking=True. Additionally, Tensors now implement Clone.

⚙️ Alternative Backends

ort is no longer just a wrapper for ONNX Runtime; it's a one-stop shop for inferencing ONNX models in Rust thanks to the addition of the alternative backend API.

Alternative backends wrap other inference engines behind ONNX Runtime's API, which can simply be dropped in and used in ort - all it takes is one line of code:

fn main() {
    ort::set_api(ort_tract::api()); // <- magic!
let session = Session::builder()?
    ...

}
</tr></table>

... (truncated)

• d1ebde9 fix: use absolute paths for crate include
• daf9104 2.0.0-rc.10
• 882056c ci(*): use latest version of rust-cache
• 180ec09 fix(sys): update binaries with fix for #392
• 410ece4 chore: match ort-sys license with main license
• 4745bb3 fix: NVExecutionProvider is not supported on linux
• 7976879 fix: ensure environment exists when registering NVExecutionProvider
• fb17d45 refactor: remove most usages of NonNull::new_unchecked
• b12b903 refactor: simplify SessionOutputs
• ab2759b feat: Update to ONNX Runtime v1.22 (#393)
• Additional commits viewable in compare view